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Abstract: We study Processor-Sharing queueing model with the hyper-exponential ser- 
vice time distribution and Poisson batch arrival process. One of the main goals to study 
Batch Processor-Sharing (BPS) is the possibility of its application to size-based scheduling, 
which is used in differentiation between short and long flows in the Internet. In the case 
of hyper-exponential service time distribution we find an analytical expression for the ex- 
pected conditional response time for the BPS queue. We show that the expected conditional 
response time is a concave function of the service time. We apply the obtained results to 
the Two Level Processor-Sharing (TLPS) model with the hyper-exponential service time 
distribution and find an expression of the expected response time for the TLPS model. The 
TLPS scheduling discipline can be applied to size-based differentiation in TCP/IP networks 
and Web server request handling. 

Key-words: Batch Processor Sharing, Two Level Processor sharing, Hyper-Exponential 
distribution, Laplace transform, Cauchy matrices. 



* PhD student at INRIA Sophia Antipolis, France, e-mail: Natalia.Osipova@sophia.inria.fr 
t The work was supported by France Telecom R&D Grant "Modelisation et Gestion du Trafic Reseaux 
Internet" no. 42937433. 



Unite de recherche INRIA Sophia Antipolis 
2004, route des Lucioles, BP 93, 06902 Sophia Antipolis Cedex (France) 

Telephone : +33 4 92 38 77 77 — Telecopie : +33 4 92 38 77 65 



La File d'Attente Avec Service a Temps Partage Avec 

Arrivees en Rafale 



Resume : Nous etudions la file d'attente avec service a temps partage avec arrivees en 
rafale, BPS ("Batch Processor Sharing"), lorsque les temps de service ont une distribution 
hyper-exponentielle et que le processus d'arrivee des rafales est Poisson. Une des motivations 
de cette etude est que la file BPS apparait naturellement lorsque Ton etudie les procedures 
d'ordonnancement favorisant les connexions courtes sur un reseau internet. Dans le cas 
d'une distribution hyper-exponentielle des temps de service nous trouvons une expression 
analytique pour le temps de reponse moyen conditionne sur le temps de service pour une 
file d'attente BPS. Nous montrons que ce temps de reponse moyen conditionne est une fonc- 
tion concave du temps de service. Nous appliquons les resultats obtenus a la file d'attente 
munie d'une politique a Temps Partagees avec Deux-Niveaux "Two Level Processor Sha- 
ring" (TLPS) avec distribution hyper-exponentielle des temps de service. Nous trouvons 
l'expression du temps de reponse moyen pour la file TLPS. La discipline de service TLPS 
peut etre utilisee pour ordonner l'acces aux ressources en fonction de la taille dans un reseau 
TCP/IP ou sur un serveur Web. 

Mots-cles : La file d'attente avec service a temps partage avec arrivees en rafale, la file 
d'attente munie d'une politique a Temps Partagees avec Deux-Niveaux, reseau TCP/IP, 
distribution hyper-exponentielle, Laplace transforment, Matrices de Cauchy. 
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1 Introduction 

The Processor-Sharing (PS) queueing systems are now often used to model communication 
and computer systems. The PS systems were first introduced by Kleinrock (see |6j and 
references therein). Under the PS policy each job receives an equal share of the processor. 

PS with batch arrivals (BPS) is not yet characterized fully. Kleinrock et al. [5j first studied 
BPS. They found that the derivative of the expected response time satisfies the integral 
equation and found the analytical solution in the case when the job size (service time) dis- 
tribution function has the form F(x) = 1 — p(x)e~ tix where p(x) is a polynomial. 

Bansal [4], using Kleinrock's integral equation, obtained the solution for the Laplace trans- 
form of the expected conditional service time as a solution of the system of linear equations, 
when the job size distribution is a hyper-exponential distribution. Also he considers distri- 
butions with a rational Laplace transform. Rege and Sengupta [12] obtained the expression 
for the response time in condition upon the number of customers in the system. Feng and 
Mishra [8] provided bounds for the expected conditional response time, the bounds depend 
on the second moment of the service time distribution. Avrachenkov et al. [2] proved ex- 
istence and uniqueness of the solution of the Kleinrock's integral equation and provided 
asymptotic analysis and bounds on the expected conditional response time. 

We study the BPS model with the hyper-exponential service time distribution. For this 
distribution we provide the solution of the Kleinrock's integral equation according to the 
derivative of the expected conditional response time. We prove the concavity of the expected 
conditional sojourn time function for the BPS model with the hyper-exponential job size 
distribution function. We note that the concavity of the expected conditional sojourn time 
for the BPS with the hyper-exponential job size distribution was proven by another method 
in PD]. 

One of the main goals to study BPS is the possibility of its application to age-based schedul- 
ing and the possibility to take into account the burstiness of the arrival process. Bursty 
arrivals often occur in such modern systems as web server. Age-based scheduling is used 
in differentiation of short and long flows in the Internet. A quite general set of age-based 
scheduling mechanisms was introduced by Kleinrock and termed as Multy-Level PS (MLPS). 

In MLPS jobs are classified into different classes depending on their attained amount of 
service. Jobs within the same class are served according to FCFS (First Come First Serve), 
PS (Processor Sharing) or FB (Foreground Background) policy. The classes themselves are 
served according to the FB policy, so that the priority is given to the jobs with small sizes. 

We study the particular case of MLPS, Two-Level PS (TLPS) scheduling mechanism. It 
is based on the differentiation of jobs according to some threshold and gives priority to jobs 
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with small sizes. The TLPS scheduling mechanism could be used to model such applications 
as size based differentiation in TCP/IP networks and Web server request differentiation. 

It was shown in [1] that when a job size distribution has a decreasing hazard rate, then 
with the selection of the threshold the expected sojourn time of the TLPS system could be 
reduced in comparison to standard PS system. 

The distribution of file sizes in the Internet has a decreasing hazard rate and often modelled 
with heavy-tailed distributions. In |9] it is shown that heavy-tailed distributions such as 
Pareto distribution could be approximated with the hyper-exponential distributions with a 
significant number of phases. 

Therefore, we study the TLPS model with the hyper-exponential service time distribution. 
We apply the results of the BPS queueing model to the TLPS model and find an expression 
of expected conditional sojourn time for the TLPS model. 

The paper is organized as follows. In Section[2]the BPS scheduling mechanism is considered 
in the case when the job service time distribution is the hyper-exponential distribution. For 
this case we provide the solution of the Kleinrock's integral equation. In Section[3]the results 
obtained for the BPS model are applied to the TLPS model, where the job size distribution 
is also hyper-exponential. An analytical expression of the expected sojourn time is found. 
We put some technical proofs in the Appendix. 
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2 The Analysis of the Batch Arrival Processor Sharing 
Queue 

2.1 Main definitions 

Let us consider an M/G/l system with batch arrivals and Processor-Sharing (PS) queueing 
discipline. The batches arrive according to a Poisson process with arrival rate A. Let n > 
be the average size of a batch. Let b > be the average number of jobs that arrive with 
(and in addition to) the tagged job. 

Let B(x) be the required job size (service time) distribution and B(x) = 1 — B{x) be 
its complementary distribution function. 

The load is given by p — Xnm, with m = /°° xdB(x). We consider that the system is 
stable, p < 1. 

Let a(x) be the expected conditional response time for a job with service time x and a'(x) 
be its derivative. Kleinrock showed in [6| that a'(x) satisfies the following integro-differential 
equation 



We are interested in the case when the job size distribution is a hyper-exponential function 



B{x) = \-Y J P l e-^ x , X)P* = 1 ' Pt>0, ^ > 0, % = 1,...,N, 1< N < oo.(2) 



By £\ and T]i we mean £\ =1 and n i= i- B Y or IL^ we mean Ei=i,...,jv,i/j and 

II, : \.,,.r B Y v * we mean * = !> ■■■> 7V - 

Without loss of generality, we can assume that 



2.2 The expected conditional sojourn time for the BPS model 

Let us first prove additional Lemma. 

Lemma 1. The zeros hi of the rational function 




a'(y)B(x + y)dy + Xn a'(y)B(x - y)dy + bB(x) + 1. (1) 




JV 



< j-lN < PN-1 < ■■■ < P2 < Ml < 00 • 



(3) 
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are all real, distinct, positive and satisfy the following inequalities: 

<b N < fi N , Hi + i < bi < fii, i = 1, N - 1. (5) 
Proof. Let us study the following equation 

*0) = o. 

Following the approach of [7] we get that it has N\ roots —bi, i = 1, N±, where N\ is the 
number of distinct elements within fa. As fii, i = 1, N are all different, /Ltj ^ jJLj, j, 
then Ni — N and there are N different roots —bi. All —bi are real, distinct, negative, satisfy 
the following inequalities: > — b^ > —^n, —fM+i > —bi > —fH, i = 1, ...,N — 1. With 
this we prove the statement of Lemma [TJ So, then it is possible to present W(s) in the 
following form: 

and from here we have Q. □ 

Before presenting our main result let us prove an auxiliary Lemma. 

Lemma 2. The solution of the following system of linear equations: 

x 



V — - = 1 a = 1 N 



1 3 



^2=1, q = i,...,n, (6) 



is given by 



n c^- 6 



•a ^-r^ — , fc = i,...,JV. (7) 



Proof. The proof is given in the appendix. □ 
Corollary 3. The solution of equation 0) is positive. Namely, Xk > for k = l, ...,N. 
Proof. As (|3j) and ©, then the statement of the Corollary holds. □ 

Now we can prove our main result. 

Theorem 4. The expected conditional response time for BPS queue with hyper- exponential 
job size distribution function as in (0) is given by: 

a(x)=c x-J2r e ~ bkX+ J2lT> «(0)=0, (8) 

k fe 
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where 



Co 



Ck 



( n^.-«) \ 



2Xn 



hl[(b 2 q -bl) 

q^k 



and where bu are the solutions of the following equation: 

Pi 



s + fa 



0. 



and are all positive, distinct, real, satisfy the following inequalities 

< b N < hn, <bi < ^, i = 1, ...,N - I. 
Proof. We can rewrite integral equation |T]) in the following way: 

/■OO C-X 

a'(x) = Xn a'{y)^ Pl e-^ {x+v) dy + \n a'(y)B(x - y)dy + b~B(x) + 1, 
Jo i Jo 

/>0O f-X 

a'(x) = AnVfie^ 1 / a'(y) e -^ y dy + Xn a'{y)B(x - y)dy + b~B(x) + 1. 

1 Jo Jo 

We note that in the latter equation / °° a 1 (y)e~ fliV dy, i = l, ...,N are the Laplace trans- 
forms of a'(y) evaluated at Hi, i = 1, N. Denote 



a'(y)e-^dy, i = l,...,N. 



Then, we have 



a'(x) = XrCS^p l L i e~^ x + Xn a'(y)B(x - y)dy + bB(x) + 1. 

Jo 

Now taking the Laplace transform of the above equation and using the convolution property, 
we get the following equation. Here we denote L a i{s) the Laplace transform of a'(x). 



Pi 



1 



Lois) =XnY + XnY + b y 

^S + Hi j S + Hi ; s + Hi s 



M.)(i-«E^j)-*i; 



s + Hi 



6 E 



s + Hi 
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Let us note that I/ a /(/Xi) = Li, i = 1, N. According to Lemma[T]and ((4]), the following 
equation holds: 

LAs) ^j S + bl \ = An E — + b E — + - (9) 



M-> = a«e^ n(a+&0 +*X> a(s+6i) + - 



.(10) 



From here we see that there exist such Ck that: 



Then, taking the inversion of the Laplace transform, we have the expression for a'(x): 

a 



t'(x) = c + E c fc e ~ 



k 

and as a(0) = 0, then for a(x) we have 



a(x) =co^-E? e ^ X + E?' «(0) = 



A' 



Now let us find Ck ■ To find cq let us multiply both parts of the equation l[TTj) by s and find 
the value at the point s = 0. Then, we have that 



ca = M«R=o = fl^p (12) 

1 li °t 



From (J4j) we have the following: 



n* 6 i = *(*)|, =0 = 1 - AnE — = 1 - Anm = 1 - p. 



So, then 

1 

co = 



1-p 

Let us find the other coefficients c,. We denote: 

c,: 



s + bi 

^(*) = ^+E^V = -+^( s )- 
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According to the system ((9]) , IjlOp we have the following: 



IL( S + Mi) ^s + ^i <-^s + Hi' 



Y &j - m ? n 



ru^-M?) 



#9 



(M» — Ms) _ ' i 



Xnp q L* + bp g , q = l,...,N, 



Y & j - rii^Q (Mi - Ms) y j + M? 

Let us notice that from we have the following: 
n^(Mi-Ms) IL( S + Mi) 



(s + Ms)Is=-m, = -Anpq, g=l,...,iV, 



then 



Z) #, _ „ (~ An ^) = An ^ J2 h l„ + ^ g = i,-,iV, 

i Ms ~i~ Ms 



EC, v— ^ Co 



So, Cj are solutions of the following linear system: 



j 

If we denote 



uJ^ = 2M' ?= 1 '-^' (13) 



c k b k , 
x fe = — — , fc = l,...,iV, 



2 An 
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the system lfT3|) will take the form ([6]) and by Lemma [2] for cj the final result is as follows: 



Cfe ~~ 2\n \b k J 2Xn 



fc = l,...,iV. 



This completes the proof of Theorem [U □ 

Corollary 5. The expected conditional sojourn time function in the BPS system with hyper- 
exponential job size distribution as in 0) is a strictly concave function with respect to job 
sizes. 

Proof. The function 

, ®k ,0k 

k k 

is a strictly concave function if a"(x) < 0. 

a"{x) = -Y J Ckb k e- bkX <0 
k 

as Cfc > 0, bk > 0, k — 1, N, which follows from b > 0, n > 0, Corollary [3] and Lemma[TJ 

□ 

Corollary 6. The expected sojourn time in the BPS system with hyper- exponential job size 
distribution as in l^j is given by 

1 - p ^ fH + bj 
Proof. As the expected sojourn time T is given by 

poo 

T BPS = / a'(x)B(x)dx, 
Jo 

then using (J5]) we receive the statement of the Corollary. □ 
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3 The Analysis of the Two Level Processor Sharing Model 

3.1 Main definitions 

We study the Two Level Processor Sharing (TLPS) scheduling discipline with the hyper- 
exponential job size distribution. The model description is as follows. 

Jobs arrive to the system according to a Poisson process with rate A. Let 9 be a given 
threshold. The jobs in the system that attained a service less than 9 are assigned to the 
high priority queue. If in addition there are jobs with attained service greater than 9, such 
a job is separated into two parts. The first part of size 9 is assigned to the high priority 
queue and the second part of size x — 9 waits in the lower priority queue. The low priority 
queue is served when the high priority queue is empty. Both queues are served according to 
the Processor Sharing (PS) discipline. 

Let us denote the job size distribution by F(x). By F{x) = 1 — F(x) we denote the com- 
plementary distribution function. We consider the case, when F{x) is a hyper-exponential 
distribution function, namely 

JV 

F(x) =l-^pie-^ x , 5^pi = l, Pi >0, Mi >0, i = l t ...,N, 1< JV < oo. (15) 

i—l i 

The mean job size is given by m = f °° xdF(x) and the system load is p — Am. We assume 
that the system is stable (p < 1) and is in steady state. 

3.2 The expected conditional sojourn time for the TLPS model 

Let us denote by T (x) the expected conditional sojourn time in the TLPS system for 
a job of size x and by T{9) the expected sojourn time of the system. 

According to [6] the expected conditional sojourn time of the system is given by: 

j^—, xe[0,6], 
I_7 Pe 

W(9) + 9 + a(x-9) 

: -, x e (0, oo), 

1 - Pe 

where pe is the utilization factor for the truncated distribution pg = A Xg , the n-th moment 
of the distribution truncated at 9 is 

/■« 

V = / ny n - 1 F(y)dy, 
Jo 



T (x) = < 
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(W(9) + 9)/(l — pg) expresses the time needed to reach the low priority queue. This time 
consists of the time 9/ (1 — pg) spent in the high priority queue, where the flow is served up 
to the threshold 9, plus the time W(9)/(l — pg) which is spent waiting for the high priority 

queue to empty. Here W(9) = 2 (i-p e ) ■ The remaining term a(x — 8) / (1 — p$) is the time 
spent in the low priority queue. 

To find a(x) we use the interpretation of the lower priority queue as a PS system with 
batch arrivals. 



Let us denote 

Fi=pie-^\ i = l,...,N, 

and prove the following Theorem: 

Theorem 7. In TLPS priority queue with the hyper- exponential job size distribution as in 
C2P: 

a[x) = c (9) X - £ ^e-"^ + a(0) = 0, 



b k {ey 



where 

co(9) 
c k (9) 

and bi(9) are roots of 



1 - pe 



b 

2\n 



( n \ 



q=l,...,N 



bk(9)Y[(bl(9)-bt(9)) 

q^k 



, k=l,...,N, 



i-t^-E^- = °. 

1 - Pe ^ s + (ii 

and satisfy the following inequalities: 

< b N (9) < p, N , (M+i < h(9) < pi, i= 1,...,N- 1. 

Proof. As was shown in 0, a'(x) — da/dx is the solution of the integral equation we looked 
at in Section [2] 

/•OC f-X 

a'(x) = An / a'(y)B(x + y)dy + An / a'(y)B(x - y)dy + bB(x) + 1. 
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■ n = i=Em 

l—pe 

i n ■ • • it- n i • i • 17 2\(l-F(B))(W(9)+e) 

to the low priority queue m addition to the tagged job is given by b — (i-/> 9 ) 

-777— 



Here the average batch size is given by n = 1 ^ j and the average number of jobs that arrive 

;ed 

The complementary truncated distribution is B(x) = 1 1 F< ^,^ , then: 



B{x) = ?t±^ = J-Yfre-KM = Y %^e-«* = Yp^, 
V ; F(9) y F W < 

p 2 = =J— pie-^ = =J—Fj, i = 1, .... iV. 
* F{0y F{9) 6 

We apply the results of Theorem [J] for the TLPS model. To calculate Co we use lfT2|) and 
(JU) and get the following 

c o(#) Hi Mi i ^ l-Pe^Vi l-pe 1-pe 

So, then 

1-/5(9 



C„(0) = 



1-P 

For c k (9), b k {9) we use the results of Theorem [4] and get the statement of Theorem [3 □ 
Corollary 8. The coefficients c k {6) > 0, k = 1, ...,iV if8>0. 

Proof. As (J3]), < &at(6») < //at, Mt+i < h(9) < m, i = 1, 2V — 1 and 6 > 0, n > when 
9 > 0, then the statement of Corollary holds. □ 



Corollary 9. For the TLPS queue with hyper- exponential job size distribution as in (Tl 
the function a(x) is a strictly concave function with respect to job sizes with positive values 
of 6. 

Proof. The function 

is a strictly concave function if a" (a;) < 0. 

a"(x) = -Y^(9)b k (e)e- b ^ x < 

k 

as c k {9) > 0, b k (9) > 0, k = 1, N, if 9 > as it follows from Corollary [8] and TheoremEl 

□ 
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Corollary 10. The expected conditional sojourn time for the TLPS queue with hyper- 
exponential job size distribution as in 115\) is not a concave function with respect to job 
sizes. 

—TLPS 

Proof. The function T (x) is a concave function, when 

T TLPS '{x)\ x= e-o > T TLPS '{x) \ x=g+ o 
1 a'(x - 6) 



x=8-0 > — \x=0+O 



As shown in [2], 



1 - pe 1 - Pe 

1 > a'{0+). 



a(x) > 



1-P' 



a (x) > > 1. 

1 - P 

TLPS 

Then, it follows that T (x) is not a concave function. □ 
3.3 The expected sojourn time for the TLPS model 



Theorem 11. The expected sojourn time in the TLPS system with hyper- exponential dis- 
tribution function U5)) is given by the following equation: 



- Xl + W{6)F{9) {m-Xp (W(8)+8) ^ 

T ( 9 > = TZ~Z + i_„ + i_ n „ 



l-(>o 1-P I-Pe i^6iW(A*i + 6#))IJ(W-W)' 

where bi{0) are defined as in Theorem^ 

Proof. According to [6] and Theorem [7] we have the following: 

1 - pe 1 - Pe 

—bps r°° f°° — 

T (6>)=/ a{x-9)dF(x)= a'{x)F{x + 6)dx, 



(Theorem^ => T BPS \o) = c (9)(m X^) + £ ^fL 
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then 

_ _ _ _ _ - rw-w) 

X\ + W(9)F(6) (m - Xi) (WXg) + fl) ^ 



T W tz~z + 1 _ n + — r— ; — 2^ ' 



□ 
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4 Conclusion 

We study the BPS queueing model, when the job size distribution is hyper-exponential, 
and we find an analytical expression of the expected conditional response time and for the 
expected sojourn time. We show that the function of the expected conditional sojourn time 
in the BPS system with hyper-exponential job size distribution is a concave function with 
respect to job sizes. We apply the results obtained for the BPS model to the TLPS scheduling 
mechanism with the hyper-exponential job size distribution and we find the expressions of 
the expected conditional response time and expected response time for the TLPS model. 

Acknowledgment 

I would like to thank K. Avrachenkov and P. Brown for fruitful discussions and suggestions. 



INRIA 



Batch Processor Sharing with Hyper- Exponential Service Time 



17 



5 Appendix 

Lemma [2J, The solution of the following system of linear equations 

12 = 1. 9=1. 



u 2 - b 2 



,N, 



is given by: 



Xk 



n 

q=l,...,N 

q^k 



Proof. Let 



be two vectors of size N, 



D 



X 


= [xi,x 2 , ■■■ 


,xn) T , 


1 


= [1,1, -,1 


llXiV 








1 


i 










1 


1 


1 









be the matrix of size N x N. Then equation (fl6|) could be rewritten as 

Dx = l. 

Applying the Cramer formulas |TT] we obtain: 

det gfc _ det [gpj, ...D[ k -i] , h D[k+i] , —D[n]] 



(16) 



(17) 



Xk 



det D det D 

^fc = [D[i], ...D[fc_i], 1, £>[fe+i], ■■■-D[jv]]- 

Since 13 is a Cauchy matrix, its determinant is known |llj : 



fc=l,..,AT, 



(18) 



detD 



n (tf-AM-* 

l<j<k<N 

n 

j,k=l,...,N 



(19) 
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As < few < jLtjv < ••• < £tj+i < bi < /ii < ... < bi < fj,\ , then detD > and we can use 
Cramer formulas to calculate Xk- Let us find detDk = det [-D[i], ..-D[fe_i], 1, -D[fe+i], 



/ 



i 



"k+1 







1 


A 




A-b'i, 


*> 


i 


1 



\ 



NxN 





l 








i 


1 
1 


1 






l 












1 


dctDk = 












vi-b'i+i 


A-b't, 




1 










1 


i 


i 










c» 


-bU 








1 
1 


1 








1 


1 






A- 
1 






»{- 


-bU 
i 




1 


( _ 1)fc -i 










-bU 




A-b'i, 




1 


1 








1 


1 


1 




4" 












^N- fe N 



NxN 



NxN 



To simplify the following computations let us introduce the following notations: 



Then, we have 



(ii — i — 2, /c, 

A = -6 4 2 , i = fe + l,...,JV. 



detD fe = (-1) 



fe-i 



detD fe = (-1) 



k-i 



l 



( M | +/ 3 2 )(^+/3 2 ) 



(Ai^+/3 2 )(^+/32) 











1 


i 






1 






~^2 



(mI+AOW+AO 



(Ai^+/3 fc )(p?+/3fc) 



M 2 +/3jv 
1 

1 



NxN 



1 1 

(m1+/3n)(^+/ 3 «) 



(^+/3«)(M?+/3«) 



NxN 



(-1) 



fc -i (Mi - Mat) 

( Ml +/3 2 )...(^+/3iv) 



1 



1 



P2+/ 3 " 
1 
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So, as the above matrix under the sign of determinant is a Cauchy matrix of size N — 1, the 
following equation holds: 

.„ tn _ / , Nfc-1 (j4 - M|MMl - M^) 2<j<q<N 

j,q=2,...,N 

Let us recall that fa = — i = 2,k, fa = —bf i = k + 1, JV, then 

n (m? - a*?) n (fi-fiWi-h) 
n n 
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n (Mi-A*?) n 
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Then, from lfT8|) and Q19|l . we have the following expressions for a^: 

n 0*2 -«) 
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what proves Lemma EJ □ 
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